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Abstract. This paper studies the effect of the distance choice in radial (non-average) statistical tools used for 
fractal characterization of galaxy distribution. After reviewing the basics of measuring distances of cosmological 
sources, various distance definitions are used to calculate the differential density 7 and the integral differential 
density 7* of the dust distribution in the Einstein-de Sitter cosmology. The main results are as follows: (1) 
the choice of distance plays a crucial role in determining the scale where relativistic corrections must be taken 
into account, as both 7 and 7* are strongly affected by such a choice; (2) inappropriate distance choices may 
lead to failure to find evidence of a galaxy fractal structure when one calculates those quantities, even if such 
a structure does occur in the galaxy distribution; (3) the comoving distance and the distance given by Mattig's 
formula are unsuitable to probe for a possible fractal pattern as they render 7 and 7* constant for all redshifts; 
(4) a possible galaxy fractal system at scales larger than lOOMpc (z ~ 0.03) may only be found if those statistics 
are calculated with the luminosity or redshift distances, as they are the ones where 7 and 7* decrease at higher 
redshifts; (5) Celerier and Thieberger's (2001) critique of Ribeiro's (1995) earlier study are rendered impaired as 
their objections were based on misconceptions regarding relativistic distance definitions. 
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1. Introduction 

From the very beginnings of modern cosmology the ques- 
tion exists of whether or not there will be a distance scale 
where the matter distribution in the Universe becomes 
uniformly distributed, or if it will always remain inhomo- 
geneous, following, in this hierarchical clumping 

pattern of matter. With the adoption of the Cosmological 
Principle by the majority of researchers working in cos- 
mology, it became standard to equate the former hypoth- 
esis to a statement of truth, meaning that most researchers 
adopted the view that there must be a scale beyond which 
a homogeneous distribution will be reached. This is the 
viewpoint presented in most, if not all, textbooks in cos- 
mology. As a consequence the latter hypothesis, that is, 
the alternative hierarchical, or inhomogeneous, viewpoint 
was pushed to the sidelines. Nevertheless, and despite the 
historical fact that since the beginning of modern cos- 
mology, in the 1920s and 1930s, the view based on the 
Cosmological Principle became dominant, the hierarchical 
proposal managed to survive on the fringes of cosmolog- 
ical research for almost a century (de Vaucouleurs 1970; 
Mandelbrot 1977, 1983; Pietronero 1987; Ribeiro 1994). 

The modern version of a hierarchical distribution of 
matter in the Universe is due to Charlier (1908, 1922), 



who followed earlier concepts from Fournier d'Albe (1907). 
Nevertheless, the hierarchical matter structuring concept 
is by no means new, but goes to as far back as the 
pressocratic Greek philosopher Anaxagoras (Grujic 2001), 
and having in its list of defenders in the last 450 years 
thinkers like Giordano Bruno, Kant, Leibniz (who op- 
posed Newton's homogeneous universe view) and Laplace, 
among others (see Grujic [2001, 2002] and Baryshev and 
Teerikorpi [2002] for historical accounts of those pre- 
modern hierarchical ideas). More recently, however, the 
dispute between these two views took an interesting new 
turn when Mandelbrot (1977, 1983) and Pietronero (1987) 
proposed that the old hierarchical concept is nothing more 
than the assumption that the matter in the Universe 
should be distributed according to a fractal pattern.^ 



^ Wertz (1970, 1971) had reached similar conclusions much 
earlier when he advanced a model mathematically identical 
to Pietronero's. Although he never used the word "fractal", 
Wertz's treatment did assume a scale-invariant, or self-similar, 
pattern for the galaxy distribution (see Ribeiro [1994] and 
Ribeiro and Miguelote [1998] for comparisons between these 
two models). Unfortunately his model remained virtually un- 
known for decades, even to Mandelbrot (1977, 1983) and 
Pietronero (1987). 
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An important technical aspect of this dispute is that 
during most of its modern ccntury-old history, hierar- 
chical modelling remained almost exclusively confined to 
the realm of Newtonian cosmology (Charlier 1922; Wertz 
1970, 1971; Haggerty and Wertz 1972; Mandelbrot 1977, 
1983; Pietronero 1987; Coleman and Pietronero 1992; 
Sylos-Labini et al. 1998; Ribeiro and Miguelote 1998; 
Abdalla et al. 1999; Pietronero and Sylos-Labini 2000; 
Pietronero et al. 2003). Although 20th century scientific 
cosmology was basically relativistic cosmology since its 
establishment in 1917 by Einstein, attempts to model the 
hierarchical concept within a relativistic framework had 
to wait until the 1970s when the first tentative relativis- 
tic models were advanced (Bonnor 1972; Wesson 1978, 
1979).2 

In the early 1990s, this author took a fresh view of the 
relativistic side of this issue, and concluded that when a 
fully relativistic model is considered the problem of ob- 
servationally identifying whether or not a uniform dis- 
tribution of matter is really being observed is much less 
straightforward than previously assumed (Ribeiro 1992ab, 
1993, 1994). Following this line of reasoning to its log- 
ical consequences, Ribeiro (1995) concluded that in an 
Einstein-de Sitter (EdS) cosmology the spatial homogene- 
ity of this model may only be observed at much closer 
ranges than previously assiuned, up to z w 0.01, which led 
this author to conjecture that the observed fractal struc- 
ture may be an observational effect of geometrical nature 
due to the fact that astronomical observations are always 
carried out along our past null cone. This means that the 
fractal, or hierarchical, hypothesis for the matter distribu- 
tion in the Universe may not be in contradiction with the 
Cosmological Principle (Ribeiro 2001ab). 

The conclusions reached in Ribeiro (1995) regarding 
the observable depth of the homogeneous region in the 
EdS model were, however, challenged by Celerier and 
Thieberger (2001) who claim that, contrary to Ribeiro 
(1995), spacetime curvature will only show its effects at 
redshift depths much larger than the range calculated in 
Ribeiro (1995). 

The aim of this paper is to discuss further the issues 
behind the relativistic side of this dispute, as well as pro- 
viding a reply to Celerier and Thieberger (2001). This 
article also presents results which extend and complement 
both Ribeiro (1995) and (2001b). In what follows it is 
shown that the radial (non-average) statistical tools used 
in fractal analyses of the galaxy distribution, namely the 
differential density 7 and the integral differential density 
7*, depend strongly on the choice of observational dis- 
tance. Taking the EdS cosmology as the model of choice 
due to its simplicity, it is possible to define four differ- 
ent observational distances, namely the area distance d^, 
galaxy area distance da , redshift distance and luminos- 
ity distance di,. Proper and comoving distances are also 
defined, but the former is equal to c?^ whereas the latter 

^ Earlier discussions on the relativistic side of this dispute 
were reported by Wertz (1970; see also Ribeiro 1994). 



is equal to times a constant factor. The distance given 

by Mattig's formula is also used, but it turns out to be the 
same as do. In addition, it is shown that in view of the fact 
that some of these observational distances go asymptoti- 
cally to infinity as one approaches the big bang whereas 
others tend to zero, the above mentioned statistical func- 
tions are strongly affected. In particular, the 7 statistic 
defined with the area distance diverges at z = 1.25, losing 
then its analytical usefulness for higher redshifts. 

The study presented here also suggests that the galaxy 
area distance, the comoving distance and, still, the dis- 
tance given by Mattig's formula are unsuitable to probe 
for a fractal pattern as they render both 7 and 7* con- 
stant for all redshift. Therefore, if a fractal pattern really 
exists at ranges greater than lOOMpc, which is the scale 
where both 7 and 7* diverge depending on the choice of 
distance, this pattern could only be found at that scale if 
one carries out statistical analyses with either the redshift 
or luminosity distances, as these are the only distance def- 
initions capable of leading 7 and 7* to a decrease at higher 
redshifts. Those findings confirm and complement similar 
results obtained earlier by Ribeiro (1992b, 1995, 2001b). 

The dependence of the radial (non-average) statistical 
functions on the choice of distance can be seen if we re- 
member that any galaxy statistic requires us to define the 
area of a spherical shell of a certain radius and since we 
have more than one distance definition we will inevitably 
end up with various expressions for such shell areas, none 
of them being better than the others, a conclusion op- 
posite to Celerier and Thieberger (2001). Actually, their 
criticism confuses observables with the relationships that 
relate them to one another and the underlying cosmolog- 
ical model. Clarifying this point renders incorrect both 
their calculations and interpretation. The main miscon- 
ception is about relativistic distances and how they are 
defined and used. Inasmuch as this issue, cosmological dis- 
tances, still causes confusion, and is at the heart of this 
and related issues (Ribeiro 2001b), further discussions of 
this subject is justified. If the meaning and use of cosmo- 
logical distances are clarified, perhaps future errors of this 
sort will be avoided. 

The plan of the paper is as follows. Sect. 2 reviews the 
issue of measuring distances of cosmological sources. Sect. 
3 develops radial 7 type dust statistics in the EdS cosmol- 
ogy, and section 4 analyzes the results and suggests that 
observers should consider probing for a possible fractal 
pattern in the galaxy distribution by using average statis- 
tics with the various distance definitions used in this paper 
in order to ascertain whether or not distortions due to the 
choice of distance are also present in the final results. The 
paper ends with a concluding section. 

2. Measuring distances of cosmological sources 

In cosmology, observational distances are defined by the 

method of measurement. This means that once we collect 
some astronomical data of cosmological relevance, say, for 
instance, redshift of distant galaxies, their apparent mag- 
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nitudes, some intrinsic source size, etc, the particular way 
we relate one observational quantity to another defines a 
particular observational distance. In other words, in cos- 
mology, measuring a distance depends on circumstances. 
In a flat and Euclidean space all methods of measure- 
ment lead to the same and unique distance. In relativistic 
cosmology, however, that is not the case and we are then 
forced to give up the notion of a correct, or right, distance. 
In relativity, distance is not an absolute concept. 

The lack of a unique distance notion means that other 
quantities used in cosmology where distance appears in 
their definitions must not be unique either. This is the 
case of volume, spherical shell, average density, and, of 
course, any statistic of galaxy distribution since they 
require distance-derived quantities. However, as in our 
neighbourhood we can take a Newtonian cosmology ap- 
proximation where all relativistic distances become the 
same, a relevant question then arises as to where those 
quantities will start to deviate from these Newtonian val- 
ues. This question is far from trivial as general relativity 
is a non-linear gravitational theory and this means that 
each observational quantity may have its own particular 
deviation regime, and which may substantially differ from 
other ones (Ribeiro 2001b). 

Observational distance definitions in cosmology are an 
issue that has been already well established in relativis- 
tic cosmology for over thirty years since G. F. R. Ellis' 
(1971) seminal contribution to this subject. In observa- 
tional cosmology, however, the generality of Ellis' con- 
clusions do not yet seem to have been fully appreciated. 
For instance, Kayser, Helbig and Schramm (1997) dealt 
with cosmological distances, as did Hogg (1999), who col- 
lected the various definitions in use in the astronomical 
literature. Nevertheless, neither quoted Ellis' (1971) fun- 
damental work on this matter, nor did they seem to have 
appreciated Ellis' results that showed how to calculate cos- 
mological distances for any cosmological spacetime met- 
ric. Actually, the roots of this discussion go back as far 
as to the famous Etherington reciprocity theorem, proved 
in 1933, and rediscovered by R. Penrose and R. K. Sachs 
in the 1960s (Ellis 1971, p. Ill; see also Schneider, Ehlers 
and Falco 1992). 

An observer, of course, may wisely ignore this whole 
discussion if one is only interested in relating observa- 
tional quantities to other observational quantities. In this 
approach, which may be called "Sandage's prescription" 
(see Ribeiro 2001b), distances become an internal param- 
eter of the theory and the choice of distance turns out to 
be irrelevant. The limitation of this approach is that if 
the final quantities are explicitly dependent on distances, 
which is the case for the average density and many statis- 
tical tools of galaxy distribution, Sandage's prescription is 
inapplicable. 

Having said all above, it is therefore wise to approach 
the subject theme of this paper very carefully. Thus, I start 
by describing the various observational distances appear- 
ing in Ellis' (1971) paper, and then proceed to the theo- 
retical issues. 
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2.1. Observational distances 

The luminosity distance is defined if one assumes a 
flat and non-expanding universe, as if it were Euclidean, 
and relates apparent magnitude, or observed flux F., with 
the intrinsic luminosity L of the source by means of the 
well-known expression 



The area distance d^ (also known as angular diame- 
ter distance, corrected luminosity distance or observer area 
distance)^ is measured by means of the relationship be- 
tween an intrinsically measured cross-sectional area ele- 
ment daA of the source and the observed solid angle dU^ 
(see figure Pi, 

da A = dn^id^f. (2) 

The galaxy area distance dc (also known as effective 
distance, angular size distance, transverse comoving dis- 
tance or proper motion distance) is similar, but defined 
from the opposite point where the area distance is speci- 
fied. The solid angle dftc is measured at the rest frame of 
the galaxy, whereas the intrinsic cross-sectional area dac 
is measured here (see figure|2|. The defining equation may 
be written as, 

da-G = dftaidaf. (3) 

The methods above for relating observables define dis- 
tances that are in principle directly measurable and do not 
necessarily need to coincide.'* Besides d^, dA, do, the equa- 
tions above also define three quantities which are mea- 
sured here, that is, at the observer's location, namely F, 
dflA^ dac, and, additionally, three other quantities which 
can only be measured at the source's rest frame, namely 
L, daA, dftc- 

Notice that as d^ and dA are directly determinable 
quantities, without assuming any cosmological model, 
their measurements are, therefore, model independent. In 
fact, precise determination of these quantities can be used 
to distinguish among cosmological models, dc is not di- 
rectly measurable since dfic cannot be determined from 
the observer's location. To be useful, da requires a further 
equation relating it to di, or (see ti2.2l below). 

2.2. Etherington's reciprocity theorem 

The observational distances discussed above are connected 
to one another and the redshift z by a very important 
theorem proved a long time ago by Etherington (1933), 

^ In this paper I will adopt Ellis' (1971) terminology for ob- 
servational distances, as I believe his name choices to be the 
least confusing, and, geometrically, most appropriate. 

^ By means of galactic parallax one can still define and mea- 
sure a fourth distance, the parallax distance dp (Ellis 1971). 
However, we are still unable to measure galactic parallaxes 
and, therefore, dp is of no use in our discussion here. 
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called the reciprocity theorem or Etherington's reciprocity 
law. It may be written as (Ellis 1971; Schneider, Ehlers 
and Falco 1992, p. Ill, 116), 

d^^{l + zfd^ = {l + z)da, (4) 

and it is valid for any cosmological model. In fact the the- 
orem is purely geometrical and only requires that source 
and observer are connected by null geodesies. It is simply a 
consequence of the geodesic deviation equation and it tells 
us that if z = that implies that equal surface elements 
dac, da A subtend equal solid angles dQ,c^ dflA, irrespec- 
tive of the curvature of spacetime (Ellis 1971). As this 
theorem is valid for all cosmologies, it has been recently 
suggested that it can be a powerful tool for testing non- 
standard cosmological models, as well as being capable of 
distinguishing between various models of dark energy by 
comparing distances measured by standard candles, that 
is, d^, and standard intrinsic dimensions, i.e., dA (Basset 
and Kunz 2004; Uzan et al. 2004). 

2.3. The necessity of a cosmological model 

So far we have not needed to establish any cosmological 
model, but as we have five expressions (eqs. ^ El 01 
containing four quantities measurable here, F, dflA, dac, 
z, plus six unknown quantities, L, di,, daA, dA, dflc, do, 
we end up with an unsolvable system. However, if we are 
able to independently determine either L or du^, the sys- 
tem can be solved. In both cases we require knowledge of 
the intrinsic physics of the source, or source evolution, a 
theory which is still lacking for galaxies. 

There is a possible way to solve the system by deter- 
mining d^. Let us call a the observed angular dimension 
of some object whose linear intrinsic dimension £a, per- 
pendicular to the line of sight can be estimated (see figure 
III). Then, 

£a « dAa, (5) 

and we can determine the area distance to a reasonable 
degree of accuracy. Notice, however, that £a is measured 
at the source 's rest frame, which means that we again need 
knowledge of the intrinsic physics of the source in order 
to estimate £a and then calculate d^ • This remark will be 
very important in what follows. 

Another attempt at looking at the difficulties above 
was the ideal observational cosmology program, which pro- 
posed to characterize in detail the way in which cosmo- 
logical observations can be directly used to determine the 
cosmological spacetime geometry (Ellis et al. 1985). The 
main motivation behind this program is to determine the 
spacetime metric of our universe directly from astronom- 
ical observations, without assuming a cosmological model 
beforehand. In the process of doing that, one must first 
determine what is and what is not decidable in cosmol- 
ogy on the basis of astronomical observations. Although 
this is an appealing idea, this program cannot be fully 
implemented due to the astrophysical evolution, both in 



number and in luminosity, of galaxies. To implement this 
program we require precise observations of d^ or d^ , red- 
shift, galaxy number counts and an adequate model of 
how the populations and luminosities of galaxies of dif- 
ferent morphologies evolve with z, that is, to know inde- 
pendently the function L = L{z) for each morphological 
galaxy type. It is presently impossible to obtain all that 
information without assuming a cosmological model. 

Another way of possibly solving this system of equa- 
tions and determining all quantities described so far is to 
find a homogeneous class of sources, that is, objects which 
share some basic features, and whose intrinsic luminosity 
L may be known. This is, of course, the idea behind su- 
pernova cosmology. The limitations of this approach are 
that the measured intrinsic supernova la luminosities at 
high z assume no luminosity evolution at different red- 
shifts due to limitations in our theoretical understanding 
of these objects (Perlmutter and Schmidt 2003; Li and 
Filippenko 2003). In addition, the building blocks of the 
universe are galaxies and not supernovas, and the picture 
emerging from supernova cosmology ought to be compat- 
ible with galactic physics and observations. Nevertheless, 
this is currently a very promising line of research in ob- 
servational cosmology. 

So, unless supernova cosmology, or another obser- 
vational methodology, firmly establishes cosmological 
model-independent relationships between values of di, and 
d^ at different z, we have no other way but to assume an 
universe model in order to obtain another equation, usu- 
ally in the functional form of either d^^z), or d^(z), or 
doiz), and be able to fully solve the system of equations 
above. 

2.4. Theoretical distances 

Once a cosmological model is assumed, we can, of course, 
define other, model dependent, distances like the comov- 
ing distance, proper distance, interval distance, geodesic 
distance, absolute distance, etc. These are all, however, 
different forms of line element separations (ds^), whose 
theoretically-defined expressions are entirely dependent 
on the spacetime geometry and the particular solution 
of Einstein's field equations.^ Their particular expressions 
change according to the cosmological model and, hence, 
they are not observationally defined distances, although 
they do play an important theoretical role in cosmology. 

2.5. The consistency problem in observational 
cosmology 

Since most observational results in cosmology either ex- 
plicitly or implicitly assume a cosmological model, usu- 
ally the standard one, in their presentation, a question 
arises immediately. Do the observational results really de- 

^ Notice that the reciprocity theorem does not require a 
solution of Einstein's field equations, but only the pseudo- 
Riemannian spacetime. 
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termine parameters compatible with the assumed cosmo- 
logical model, as they should? This is the consistency 
problem in observational cosmology (Ribeiro and Stoeger 
2003). Consistency tests are, therefore, desirable, in order 
to check the agreement between the derived observational 
parameters and the cosmological model they assume. This 
means that we can only discuss the possible departures 
from a homogeneous matter distribution if we choose an 
average density that theoretically allows such a departure 
and then check the model for consistency with the data. In 
order words, once we calculate observational parameters 
by means of a cosmological model, the agreement or dis- 
agreement between the data and the model will be tested 
by consistency or inconsistency. 

3. Radial dust statistics in the Einstein-de Sitter 
cosmology 

Let us define another relation which may be called an 
observational distance, the redshift distance dz. It may be 
written as, 



Ho' 



(6) 



where, c is the light speed and Hq is the Hubble con- 
stant. This is, of course, just a consequence of the velocity- 
distance equation and the Doppler approximation in a ex- 
panding universe, being valid only for z < 1 (Harrison 
1993). It is not an observational distance in the sense as 
discussed above, but a quantity proportional to small red- 
shifts in the standard cosmology. However, since this is 
the defining equation of the Hubble law (Harrison 1993) 
and is often used in observational cosmology, it is useful 
to list it here alongside the previously discussed cosmo- 
logical distances and adopt equation © as the defining 
expression of dz for all z. 

3.1. Radial (non-average) statistical tools 

Let us now call generically by do some observationally 
defined distance. It can be any of the four distances di,, 
dA, da, dz defined so far. If So is the area of the observed 
spherical shell of radius do, and Vq the observed volume 
of radius do, we have that. 



So - Mdof 



(7) 



Vo 



4 3 



Following J. Wertz, I define the differential density 
7 (do) = 7o at a certain distance do as being given by the 
following expression (Wertz 1970, 1971; see also Ribeiro 
and Miguelote 1998), 



70 = 



1 dNc 
So d{do) ' 



(9) 



where Nc is the cumulative radial number count from the 
origin of sources. 



The integral differential density 7* (dp) = 79 is the in- 
tegration of 7o over the observational volume Vq. Its equa- 
tion yields 



7o - / 7ido)dVo 

^0 Jva 



. jix)dx. (10) 
(do) "'0 



The two definitions above look similar to the condi- 
tional densities T and T* appearing in Pietronero (1987). 
However, it is important to point out the difference be- 
tween the radial (not averaged) 7 and 7* statistics and 
the non-radial, but averaged, F and F* statistics. The dif- 
ferential density 7 and its integral version measure how the 
density scales as a function of distance, whatever distance 
choice, whereas the conditional density F is an average 
quantity, measuring the density from an occupied point 
and then averaged over all realizations of a given stochas- 
tic process. For the galaxy distribution what one does 
is to use a volume average to calculate the conditional 
density F and the average conditional density F*, which 
is an averaged integral of F (Pietronero 1987; Coleman 
and Pietronero 1992; Sylos-Labini et al. 1998; Pietronero 
2003). Therefore, computing radial (7) and non-radial (F) 
statistics are the result of different operations. 

Therefore, here I follow Wertz's (1970, 1971) original 
contribution and will be approaching this problem from 
a regular (analytical) viewpoint, in addition to assuming 
that classical general relativity is a valid and appropriate 
tool for modelling the smoothed out large scale distribu- 
tion of galaxies. This means that this paper deals with 
radial (non-average) 7 statistics derived from theory and 
attempts to see what the final results could suggest for 
the calculation of the non-radial (average) F statistics ob- 
tained from galaxy catalogues.^ 

3.2. Radial statistics of the Einstein-de Sitter 
cosmological model 

The EdS metric may be written as (from now on c = G = 
1), 

ds^ dt^ - a^{t) [dr^ -I- [dO^ + sin^ edcj)"^)] . (11) 

The observational distances will then be given by the ex- 
pressions below. 



di(z) = — (l + z-Vl + z), 

^0 



(8) d,(z) 



2 (l + z-vTT^) 

^^0 {l + zf 



daiz) = — — 

Ho \ z 



(12) 
(13) 
(14) 



whereas the cumulative number count yields, 
m^i'^ C^'-"^ )'- (15) 



HoM„ 



1 + z 



I have not used Wertz's original symbol po for the differ- 
ential density as it could be confusing in the present context. 



6 



Marcelo B. Ribeiro: Cosmological distances and fractal statistics of galaxy distribution 



where Mg is the average galactic rest mass 10 A/q). 

Considering equations and © we can define four 
observational spherical shells and volumes as follows: 

IGtt 



(Ho) 



:(l + 2 - VI +z)' 



Sa — 



{HoY 



Sn = 



IGtt / 1 + z - VI + z 



V,. 



(Hoy 



1 + z 



(Ho) 
327r 



2 ' 



■(1 



KHor 

327r (1 + z - VT 



3(i/o)3 
327r 



1 + z - VI + -z 

Tl~z 



(16) 
(17) 
(18) 
(19) 
(20) 
(21) 

(22) 
(23) 



It is convenient to express all quantities in terms of 
the redshift. Therefore, equation Q should be rewritten 
as below, 



70 



dz 



6 



dz 



1 + z - y/T+z) 



HoMn 



(1 + ^) 



7/2 



dz 



(24) 



We are now able to write the differential density in terms 
of the redshift for each observational distance that enters 
in its defining equation above. They yield. 



1l 



1a 



Mo 



(2vm-i)(i + z)'' 



/io(l + z) 



(3 - 2vm) 

7g = Aio, 



4/io(i + z- vm)' 



z2(l + z) 



7/2 



where, 



Mo 



(25) 

(26) 
(27) 
(28) 

(29) 



Two conclusions can immediately be drawn from the 
equations above. Firstly, the differential density 7^, calcu- 
lated by means of the galaxy area distance da, is constant 



for all redshift. In other words, the use of such a distance 
makes the analysis completely insensitive to any change 
in the dust distribution of the EdS cosmology. In other 
words, using da we reach the conclusion that the dust dis- 
tribution is homogeneous everywhere, even along the past 
null cone (or the lookback time). This is a built-in fea- 
ture of the model and means that this quantity is of no 
use for probing the possible inhomogeneity of the observ- 
able Universe. Such a result was also reached by Ribeiro 
(2001b) by means of a somewhat different path. Secondly, 
it is clear from equation H26|l that 7^ diverges aX z — 1.25, 
losing then its analytical usefulness for higher redshifts. 

Finally, we are now in a position to calculate the in- 
tegral differential density for each observational distance. 
If we rewrite equation H1U|I in terms of the redshift we get 
that, 

I r , , dVo{z) 
'^o(^) = TTTT / 70 z —1 — dz. 30) 
Vq[z) 7o dz 

Using the expressions obtained above for volume and the 
differential density in each observational distance we ob- 
tain the following equations for the integral differential 
density, 

^ fioil + z)-\ (31) 
7l = Mo(l + z)', (32) 

7g = MO, (33) 

3 



8mo 



1 



z(l-hz) 



(34) 



It is useful to define the average numerical density (n) 
of a certain observational distance do as being given by 

(no) = iV,/Uo. (35) 

With the expressions obtained so far it is straightforward 
to show that the equations below hold: 

{n.)=ll, (36) 

M^ll, (37) 

{no) = l*a. (38) 

{nz)^i:- (39) 

All results above agree and expand both Ribeiro (1995) 
and (2001b). The former, however, limited the analysis to 
the luminosity distance, while the latter concentrated on 
the behaviour of the average densities and their impli- 
cations for the possible observational smoothness of the 
Universe. Equations (|25|l and H31() are equal to the ones 
appearing in Ribeiro (1995), with the difference that here 
they are a function of the redshift, whereas in Ribeiro 
(1995) they were written in terms of d^- 

Notice again that 7* and, therefore, (nc) are constant, 
meaning that if one carries out consistency checks (see t |2.5l 
above) between possible observable departures from ho- 
mogeneous distribution, even at small scales (z < 0.1) one 
should not use the galaxy area distance da . It would seem 
incorrect to do so because this distance renders constant 
its associated average density for all z. 
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3.3. Theoretical distances 

We should now relate the expressions obtained above with 
other theoretical distances which often appear in the lit- 
erature. The proper volume is defined as follows, 



dVpn = a^r^dr sin ( 
and the comoving volume yields, 
dVn = r^dr sin ( 



(40) 



(41) 



It is easy to show that in the EdS cosmology the area 
distance and the proper distance dp^^ are given by the 
same expression (Ribeiro 1992b, 1995, 2001b; Ribeiro and 
Stoeger 2003), 



dpR = a[t{r)] r 



(42) 



and, therefore, have the same relationship to the redshift 
as given by equation (|13|l above. 

As it is well known, the comoving distance dc may be 
written as below, 



a 



18 



1/3 



l + Z 



smce 



HHo) 



1/3 



(43) 



(44) 



Therefore, comparing with equation H14|) it follows that. 



da = 



9{Ho) 



1/3 



(45) 



Thus, the comoving distance, and, as a consequence, the 
comoving volume, are just the galaxy area distance times a 
constant factor, having then the same analytical behaviour 
with z as any expression containing do . 

It is often the case in studies of galaxy statistics to 
use the famous Mattig formula to convert redshifts to dis- 
tances. In the EdS cosmology it is easily proven that 



Ho 



1 



l + z 



(46) 



So, the distance given by Mattig's formula is nothing more 
than the galaxy area distance. 

The results obtained above show that the analysis pre- 
sented in this paper does not need to refer to these often 
adopted theoretical distances, since by studying the be- 
haviour of d^ and da we will have them taken into ac- 
count. 

3.4. Reply to Celerier and Thieberger (2001) 

In attempting to justify their different approach to the 
problem, Celerier and Thieberger (2001; from now on 
CTOl) have stated the following on page 452 of their pa- 
per: "... the luminosity distance is the observable quantity 
relevant for radially measured distances (...) But, when 



looking at a cross sectional area (...) perpendicular to the 
light ray and subtending a solid angle (...), the observer 
must consider the area distance." Then they obtain ex- 
pressions for the radial differential density and volume 
element different from the ones appearing above. Those 
expressions were then used as the basis for their subse- 
quent study and conclusions. 

CTOl seem to have assumed that because the area dis- 
tance c?A is defined by means of a cross sectional area da a, 
which is measured at the source's rest frame, it is then 
the "correct" quantity to define the area of the observed 
spherical shell, with all other distances being, therefore, 
incorrect to use in this case. Moreover, they believe that 
di is the "correct" distance for radial measure. Let us see 
why this reasoning is not correct. 

Any observed distance, be it d^,, d^, da or dz, define an 
observable spherical shell and a radial measure for a given 
z. Because these distances are different, the shells will then 
have different radii and areas, but, nevertheless, they can 
be calculated from observations because these distances 
can be defined and observed. Even theoretically defined 
distances like the comoving and proper distances will also 
define spherical shells. The particular aspect about the 
area distance is that if, and only if, in our astronomical 
observations we, independently of a cosmological model, 
had also been able to observe and tabulate intrinsically 
measured dimensions such as dcr^ or (see eqs. |5J |S1 
and figure [T]l. then the method to relate those intrinsi- 
cally measured dimensions with the observed solid angle 
dQji, or the observed angular dimension a, would be by 
means of equations which will result in measuring the area 
distance d^. This has nothing to do with the definition of 
spherical shells and measuring their areas or radius. 

Similarly, if, independently of a cosmological model, 
we were able to measure the intrinsic luminosity L of a 
cosmological source, then by measuring its observed fiux F 
we will be able to relate these two quantities and obtain a 
distance called luminosity distance. Such a procedure has 
nothing to do with a so-called "radial distance measure" , 
but it is simply a method to obtain a specific distance by 
means of two different, but directly observable, quantities. 
Supernova cosmology is, of course, based exactly on this 
methodology and, due to that, it is able to actually verify 
a cosmological model rather than assume one (Perlmutter 
and Schmidt 2003). 

CTOl confuse two different distances when they wrote 
their differential density.^ With the notation adopted in 
this paper CTOl's equation (20) can be written as follows: 



7CT01 



1 dNc _ dNc 
Sa d{dL) dz 



SA-^idt 
dz 



^ Both Ribeiro (1995) and CTOl calculated radial (non- 
average) 7 statistics, but named them with the symbol F for 
non-radial (average) statistics. As discussed above (see il3.1ll 7 
and r are different quantities and, therefore, one should use 
different symbols to avoid confusion. 
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^ 3{Hof (1 + z) 
8nMg (2VTTI - 1) ■ 

Notice how two entirely different methods for measuring 
the distance of a cosmological source are included in the 
same equation. They further defined an observed volume 
element as follows (CTOl's eq. 21), 

d^cToi = d{d^). (48) 

Everything else in their paper follows from these two equa- 
tions. It is important to point out that as at the same 
redshift ^ with d^ > dA (see il2.2l abovel. in both 
expressions above there will be a mismatch between Sa 
and di. So, for a given z the volume element dVc-voi will 
have a spherical area Sa whose radius is smaller than 
the distance d^ where this spherical area is supposed to 
be located. It seems difficult to justify such a procedure. 

As we shall see below, the results obtained by CTOl 
are different from Ribeiro's (1995) because densities de- 
fined with the area distance grow forever, inasmuch as 
dA has the peculiar feature of vanishing at the big bang. 
However, the luminosity distance behaves in an opposite 
manner and goes to infinity at the big bang. Therefore, a 
density defined with d^, vanishes at the big bang, while an- 
other density defined with d^ tends to infinity (see Ribeiro 
2001b). By confusing these two distances CTOl smooth 
out the eventual decrease of density in their expression, 
as compared to Ribeiro's (1995), due to an incorrect alge- 
braic manipulation. 

4. Analysis 

We are now in a position to discuss the results obtained 
in the previous section. Figure |2I shows graphs of the dif- 
ferential density 7 for all observational distances (proper 
and comoving distance behave as d^ and dc respectively 
- see ij3. 31 above). The plots show very clearly the entirely 
different behaviour of 7^ on one hand, and 72 and 71, on 
the other. Notice that 7g is constant for all z and that 7^ 
diverges at z = 1.25. Figure 01 shows the integral differ- 
ential density 7* for each observational distance. Notice 
again the entirely different behaviour one obtains if one 
uses dc instead of d^ or d^ . 

The homogeneous behaviour in this case is given by 
the function obtained with the galaxy area distance dc, 
and the plots show quite clearly that deviations from ho- 
mogeneity start to occur at z = 0.01. At z = 0.1 this devi- 
ation is meaningful. Notice that if one adopts the distance 
as given by Mattig's formula or the comoving distance one 
ends up with the same behaviour as given by dc, having 
therefore, no deviation from homogeneity, hy construction. 

These results suggest that one should not adopt these 
distances when trying to probe whether or not the galaxy 
redshift survey data show, or do not show, an eventual 
homogeneous pattern. In this respect, it is important to 
point out that many authors do adopt those apparently 
unsuitable distances when trying to ascertain a possible 
homogenization of the galaxy distribution. Among a few 



recent analysis, both Tikhonov et al. (2000) and Martinez 
et al. (2001) started with Mattig's equation, while Cappi 
et al. (1998) adopted the comoving distance. On the other 
hand Sylos-Labini et al. (1998), Joyce et al. (1999) and 
Pietronero et al. (2003) seemed to have used dz instead. 

So, in view of the results presented here one may be 
compelled to ask how those results may affect the statistics 
of data stemming from galaxy redshift surveys. 

One is faced with a fundamental difficulty if one tries 
to answer this question by means of the analysis presented 
above. The main problem stems from the fact that the 
data gathered from galaxy redshift surveys is presented in 
terms of non-radial and averaged statistics, whereas here 
all quantities were discussed in terms of radial and non- 
averaged ones. As seen above, radial and non-radial statis- 
tics are the result of different operations (see ^3.1(1 . As 
clearly shown in figures 01 and 01 the use of different choices 
of distance produce distortions in the radial statistics and, 
thus, it is reasonable to suppose that similar distortions 
could affect the non-radial statistics as well. Nevertheless, 
there are no studies about this possible effect in statis- 
tics derived from galaxy catalogues as the distance prob- 
lem has been mostly ignored so far in observational cos- 
mology by both sides of the fractal controversy (Joyce et 
al. [1999] have, nonetheless, showed that non-radial densi- 
ties are strongly affected by the kind of distance-redshift 
used). Therefore, the presence and strength of such a pos- 
sible distortion showing itself in data obtained from galaxy 
catalogues remains, so far, an open problem. 

Another important caveat is that the analysis pre- 
sented above is bolometric, while real data analysis stem- 
ming from redshift surveys are always in a limited fre- 
quency range and often require the use of some form of K- 
correction. As discussed elsewhere (Ribeiro 2002; Ribeiro 
and Stoeger 2003) a full relativistic analysis of radial 
number count where those effects are taken into consid- 
eration may affect very strongly the final quantities. In 
particular the luminosity function can only be compared 
with theoretical number count by means of complex equa- 
tions which may seriously affect and change the theoreti- 
cal quantities (Ribeiro and Stoeger 2003). As noticed by 
Joyce et al. (1999), a simple luminosity function where 
those effects are not taken into account may change com- 
pletely the final results of whether or not the data from the 
ESP galaxy survey show, or do not show, a scale invari- 
ant pattern. Other factors like the type of FLRW model 
as well as the existence or not of dark energy and a non- 
zero cosmological constant may also affect the statistics 
in unpredictable ways. Finally, even the calculation of the 
average density is affected by those effects (Ribeiro and 
Stoeger 2003). It is beyond the scope of this paper to 
carry out a fully relativistic analysis to derive the average 
density from the luminosity function parameters, which 
themselves were calculated from galaxy catalogues, that 
is, where the data was obtained with limited frequency 
range observations, as well as some kind of morphologi- 
cal classification. Such an analysis should shed some light 
on those issues (Albani and Ribeiro 2004, in preparation). 
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but we may well assume in advance that those effects may 
be strong. 

Considering those caveats the safest thing that could 
be said at this stage is that observers should take into con- 
sideration the possible distortion of their statistical anal- 
yses of galaxy surveys due to the adoption of different 
distance definitions. This may be especially true in the 
fractal controversy. Comparing data reduced with the co- 
moving distance or by means of the Mattig formula with 
data reduced with the redshift distance could, perhaps, be 
one of the sources of controversy. Therefore, it would be 
very interesting to see the results if Cappi et al. (1998), 
Tikhonov et al. (2000) and Martfnez et al. (2001) were 
to reduce their data by assuming either dj, or d^, and if 
Sylos-Labini et al. (1998) and Pietronero et al. (2003) were 
to do the same, but adopting now dc or dc- 

5. Conclusion 

In this paper, I have discussed the effect of the distance 
choice in statistical tools used for possible fractal charac- 
terization of the galaxy distribution. I reviewed the ba- 
sic notions of measuring distances of cosmological sources 
and used the area distance d^, the galaxy area distance 
dc, the luminosity distance d^,, the redshift distance dz, 
as well as the comoving and proper distances, dc and dpn 
respectively, to calculate the differential density 7 and the 
integral differential density 7* of the dust distribution in a 
Einstein-de Sitter cosmology. The results showed the fun- 
damental role played by the choice of distance in the deter- 
mination of the scale where relativistic corrections must be 
taken into account as both 7 and 7* are strongly affected 
by the choice of distance. It is also shown that an inappro- 
priate distance choice may lead to a failure to find evidence 
of a galaxy fractal structure when one calculates those two 
statistics, even if a self-similar structure does exist in the 
galaxy distribution. In particular, d^, dc and the distance 
given by Mattig's formula seem unsuitable to probe for a 
fractal pattern as these two radial densities become con- 
stant for all redshifts when those distances are used in 
their calculation. This is a built-in feature of the EdS cos- 
mological model. The analysis also suggests that if a frac- 
tal pattern really exists at ranges greater than lOOMpc, 
it can only be detected at that scale by these statistics 
if they are calculated with either d^ or dz, as these two 
distance definitions are the only ones where, by theory, 7 
and 7* can decrease at higher redshifts. I have also shown 
that Celerier and Thieberger's (2001) critique of Ribeiro's 
(1995) earlier study, partially re-obtained here, is incor- 
rect due to misconceptions regarding relativistic distance 
definitions, rendering their objections impaired. 
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Fig. 1. The area distance is obtained by the relationship between the intrinsic cross-sectional area da^^ of the 
source, measured at its rest-frame, and the solid angle dQj^ measured by the observer (eq.|2Jl- K an intrinsic dimension 
£ji can be measured at the source's rest-frame and its corresponding angular dimension a is measured by the observer, 
one can estimate (eq. • In the Einstein-de Sitter cosmology dji is the same as the proper distance (see . 



12 



Marcelo B. Ribeiro: Cosmological distances and fractal statistics of galaxy distribution 




Fig. 2. The galaxy area distance do is obtained by the relationship between the cross-sectional area dac measured at 
the observer's rest- frame, and the solid angle dQ,G measured at the source's rest- frame (eq.|2)l- In the Einstein-de Sitter 
cosmological model this is the same distance as given by Mattig's formula, also having the same behaviour against z 
as the comoving distance (see H3.3() . 
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Fig. 3. Plot of the difTerential density 7 for each observational distance in EdS cosmology. Here /iq is a constant factor 
related to the Hubble constant and galactic rest mass (see eg. 129(1 . The proper and comoving distances are included, 
since the former is equal to d^, whereas the latter has the same behaviour against z as dc- Notice that the distance 
obtained by means of Mattig's formula is equivalent to choosing do (see The curves show very clearly the strong 

dependence of 7 with the chosen distance. 7^ diverges at z ~ 1.25 and loses then its analytical significance for higher 
z. Notice too that by mixing up the opposite behaviour of 7 as given by and dj^, CTOl have in fact smoothed out 
both the increase and decrease of 7^ and 7^, respectively, explaining then the odd behaviour obtained by them. 



14 



Marcelo B. Ribeiro: Cosmological distances and fractal statistics of galaxy distribution 



1000 



100 



7*^0 1 




0.01 



0.001 I ' ' ^ ' ' ^ ' ' ^ ' ' ^ ' 1 

0.0001 0.001 0.01 0.1 1 

z 

Fig. 4. Plot of the integral differential density 7* for each observational distance in EdS cosmological model (/^o is a 
constant factor defined in eq. 129(1 . Both the comoving and the proper distances are included as they are respectively 
equivalent to do and d^. Again, the choice of distance fundamentally changes the behaviour of 7* for higher redshifts. 
The homogeneous situation is obtained when one adopts the galaxy area distance da, or the comoving distance, or, 
still, the distance given by Mattig's formula (see H3.3|l . Notice that a significant deviation from the homogeneous case 
occurs at the relatively low value of z = 0.03 lOOMpc) when 7* remains constant whereas all others do not. Since 
the integral differential density is the same as the average number density (see eas. I36tl5n|) . 7* is the best statistical 
test for general tendencies of the galaxy clumping behaviour. 



